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ABSTRACT 
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We  consider  the  effects  of  small 
random  perturbations  on  deterministic 
systems  of  differential  equations.  The 
systems  of  interest  have  a steady  state 
that  is  a saddle  point.  A first  exit 
problem  is  formulated.  The  quantity  of 
basic  interest  is  the  probability  of 
exit  from  a band  around  the  determinis- 
tic separatrix  through  a specified 
boundary,  conditioned  on  initial  posi- 
tion. A technique  for  the  approximate 
calculation  of  this  probability  is  given. 
As  an  example,  we  show  how  the  theory 
applies  to  the  calculation  of  the 
probability  of  victory  in  a combat  that 
has  a stochastic  component. 
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SECTION  I 


FORMULATION  OF  THE  EXIT  PROBLEM 

Let  X(t,e)  be  a random  variable  that  represents  the 
state  of  a system  at  time  t.  We  assume  that,  given  X(t,e)  = x, 
the  increment  dX  is  normally  distributed  with  mean  b(x)dt  + 
o(dt)  and  covariance  ea(x)dt  + o(dt).  The  process  X(t,e) 
will  satisfy  the  Ito  equation: 

dX  =*  b(X)dt  + v/ea  (x)  dW  X = (X1,  X2) 

We  consider  the  analysis,  for  small  e , of  the  above 
stochastic  equation  when  the  reduced  deterministic  system: 

dx1  = b1 (x)dt  i = 1,  2 

has  a steady  state,  X , that  is  a saddle  point.  Such  equations 

s 

arise,  for  example,  in  chemical  reaction  dynamics  (Chang  and 
Schmitz,  1972;  Mangel,  1977),  population  dynamics  (Ludwig,  1975), 
and  in  Lanchester's  equations  of  combat.  We  will  discuss  the 
last  case  in  section  III.  The  saddle  point  gives  rise  to  a 
deterministic  separatrix,  S (see  figure  1).  We  surround  the 
separatrix  by  a band  with  boundaries  I and  II,  as  shown  in 
figure  1.  Let  T(x)  = min  (t:X(t)€I  or  X(t)€II,  conditioned  on 
X(0)  = x) . We  have  suppressed  the  e in  the  above  definition 
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of  T(x).  Let  u(x)  be  the  probability  that  X(T(x))fEII. 

Namely,  u(x)  is  the  probability  that  the  process  X(t)  first 
exits  from  the  band  around  the  separatrix  through  boundary  II, 
given  that  X(0)  = x. 

Then  u(x)  satisfies  the  backward  equation  (Feller,  1971) 

0 = — — i j + b^u^  u(x)  = 0,  x €1;  u(x)  » 1,  x€II.  (3) 

In  (3),  subscripts  indicate  differentiation  and  repeated  indices 
are  summed  form  1 to  n (n=2  in  this  case).  Feller  (1971)  gives 
interpretations  for  b1  and  ea1]  in  terms  of  the  averages  of 
functions  of  dx.  Equation  (3)  is  a singularly  perturbed 
elliptic  equation.  If  e=0,  equation  (3)  becomes 

0 - bS^  , u (x)  = 0,  xei;  u(x)  = 1,  x€II  (4) 

Let  A denote  the  region  between  I and  S,  not  including  S;  let 
B denote  the  region  between  II  and  S,  not  including  S.  The 
solution  of  equation  (4)  is  then: 

u(x)  =0  for  x€A;  u(x)  = 1 for  x€B 
u(x)  indeterminate  for  x€S. 

Thus,  for  e=0  (the  deterministic  case),  u(x)  is  a discontinuous 
function.  For  small  e,  we  expect  that  the  discontinuous  solution 
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will  be  "smeared  out"  into  a 'boundary'  layer  around  the 
deterministic  separatrix.  This  is  indeed  the  case. 
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AN  APPROXIMATE  SOLUTION 

In  this  section,  we  will  construct  an  approximate  solution 
of  equation  (3)  by  a generalized  "ray  method".  We  consider  the 
one-dimensional  canonical  problem: 


0 = ^xx  + bux  , 


u(rQ)  = 0 ? u(r1)  = 1 


Assume  that  b(x)  « 0 has  a solution,  X_  , and  the  b (X  ) > 0, 

s s 

Then  X is  a "one-dimensional"  saddle  point.  The  solution  of 
s 

equation  (5)  is 


u(x) 


exp{*/  Hlyfdy}  ds 

/ expj  -/  §|$-  dyj  ds 


For  small  values  of  the  parameter  e , the  above  solution  can  be 
analyzed  by  Laplace's  method  (Olver,  1974).  We  find  that 


u (x)  = k(x,e)E(b'  (X  IJ^Ix-X  )/(ea(Xj)’5) 

S S o 


+ e**  h(x,e)E'  ((b'  (X  ))**(x-X  )/(ea(X  ))**) 

s s s 


(5) 


(6) 


(7) 
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In  equation  (7),  k(x,e)  and  h(x,e)  are  power  series  in  e , 
and  E(z)  is  the  error  function.  It  satisfies  the  differential 
equations 

E (z)  s=  exp(-z2/2)  and  E (z)  = -z  E (z)  . (8) 

The  value  of  z in  equation  (8)  varies  over  a (possibly  infinite) 
range  zQ  < z < z^  . This  result  suggests  that  a possible  solution 
of  equation  (3)  is 

u (x)  » g(x,e)E(i|>  (xl/c**)  + e,*h(x,e)E  (^(xj/e*5)  , (9) 


where  g,  h,  and  ip  are  to  be  determined  as  functions  of  x.  We 

assume  that  g and  h will  have  power  series  of  the  form 

g(x,e)  = Zgn(x)  en»  h(x,e)  = 2^hn(x)  en.  When  derivatives 

are  evaluated,  equation  (8)  is  used  to  replace  E"  (ip/e  ) by  the 
9 k k 

product  -E  (lp/e  ) ip/e  • After  substitution  into  equation  (3)  , 
terms  are  collected  according  to  powers  of  e . The  leading  terms 
will  vanish  if  the  following  equations  are  satisfied  (also  see 
Mangel  and  Ludwig,  1977;  Mangel,  1977); 
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bX\p . “ 


(10) 
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Equation  (10)  is  a first  order  partial  differential  equation.  It 

can  be  solved  by  the  method  of  characteristics  (Courant,  1962) . 

The  characteristics  are  called  rays  (see  Ludwig,  1975;  Mangel,  1977; 

for  a fuller  interpretation  of  the  rays) . Hence,  we  call  this 

technique  a generalized  ray  method.  Initial  data  for  the  function 

i|;  can  be  determined  by  Hamilton- Jacobi  theory;  we  find  that 

ip  = 0 on  the  deterministic  separatrix.  Equation  (11)  indicates 

that  g^  is  constant  on  deterministic  trajectories.  The  values 

of  g°  and  the  endpoints  zQ,  z ^ are  chosen  so  that  the  leading 

0 k h 

order  term  in  the  asymptotic  solution  (i.e.,  u(x)~g  E(i|»(.i)/e  )+0(e  )) 
satisfies  the  boundary  conditions  u(x)  = 0 on  I and  u(x)  * 1 
on  II.  Once  g°  and  iMx)  are  known,  contours  of  equal  first 
exit  probability  can  be  constructed  by  solving  the  equation  i|;(x)  = 
constant  (see  Mangel  and  Ludwig,  1977;  Mangel,  1977). 
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STOCHASTIC  LANCHESTER  EQUATIONS: 
PROBABILITY  OF  VICTORY 


As  an  example  of  the  above  theory,  we  shall  consider  a 
model  of  the  combat  between  two  forces  (e.g.,  Morse  and  Kimball, 
1946).  The  deterministic  equations  used  to  model  the  combat  are: 

dx1  = (ax^  - bx1x2)dt  + o(dt);  x1(0)  = xj 

dJf2  = (cx2  - dx^x2)dt  + o(dt);  x2(0)  = x2. 

The  constants  a,  b,  c,  d are  all  assumed  to  be  greater  than  zero. 

Equations  similar  to  (12)  and  (13)  arise  in  theoretical  population 

dynamics  (e.g.,  the  completion  between  two  species  for  ore  resource) 

The  first  terms  on  the  right  hand  side  of  each  equation  represent 

the  rate  at  which  forces  are  added  to  the  combat;  the  latter  terms 

1 2 

represent  the  losses  due  to  combat.  The  point  (X  , X ) = (c/d,a/b) 

s s 

is  a steady  state  of  the  system  (12,13).  It  is  a saddle  point. 

In  order  to  account  for  stochastic  effects  during  the  combat, 
we  might  replace  (12,  13)  by  the  following  stochastic  equations: 

dX1  =*  (aX1  - bX1X2)dt  + \/ea(X)dW1 

dX2  = (cX2  - dXXX2)dt  + Vea(x}dW2 
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(12) 

(13) 


(14) 

(15) 


- 


In  the  above  equations,  W^(t)  and  W2 (t)  are  two  independent 

2 

Wiener  processes  (Brownian  motion) . If  boundary  I is  the  x 
axis  and  boundary  II  is  the  x1  axis,  the  u(xQ),  as  defined 
in  previous  sections,  is  the  probability  that  if  a combat  starts 
with  X1(0)  = xj  and  X2(0)  = x2  , then  force  1 will  be 
victorious.  The  probability  of  victory  can  be  calculated  by 
using  the  technique  described  in  section  II.  The  results  given 
hare  generalize  the  work  of  Brown  (1963). 
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